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Meeting Kick off 


Aug 23rd, 2017 


@ Meeting Logistics 


LI Topic: SPHERES/Astrobee Working Group (SAWG) Quarterly Meeting 
LJ Purpose: Information sharing across the SPHERES & Astrobee 
community - not intended to be pi acl eee 

Date: Wed, Aug 23rd, 2017 i. . 
Location: Virtual 
Time: 8:00 am, PST 


JOIN WEBEX MEETING 


Meeting number: 392 669 018 
Meeting password: Astrobee!8 \“\% 
Join by phone: 1.844.467.6272 
pass code: 445068 
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SPHERES Welcome 
SPHERES Facility 
SPHERES Ops 
SPHERES Eng 
SPHERES PIM 
Astrobee 
Astrobee Sim 
VertigoSmoothing 
Zero Robotics 
SLOSH Lessons 
Tether Slosh 
SVGS-RINGS 
Metis—RFID 
HoneyBee-UDI 
Tethers—CobraBee 
Altius 
Stanford-—Gecko 
IlLlinois—Elecro 
Mary Land-Gripper 
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Concluding remarks(Q@5 


Andres Martinez 
Jose Benavides 
Aric Katterhagen 
Jonathan Barlow 
Melissa Boyer 
Maria Bualat 
Andres Mora Vargas 
Danilo/Alvar 
Katie Magrane 
Brandon MarselLl 
Hans Zachrau 
Hector Gutierrez 
Jose Cortez 

Jack Wilson 

Nathan Britton 
Jonathan Goff 
Abhishek Cauligi 
Matthew Spenko 
Christine Hartzell 
Jose B. Realm 


Synchronized Position Hold Engage 
Reorient Experimental Satellites - SPHERES 


ay 


¢ A Facility of the ISS National Laboratory with 
three IVA nano-satellites designed and 
delivered by MIT to research estimation, 
control, and autonomy algorithms 
¢ Installed on ISS in 2006 
¢ Managed by ARC since Fall 2010 
¢ By working aboard ISS under crew supervision, 
it provides a risk tolerant Testbed Environment 
for Distributed Satellite & Free-flying Control 
Algorithms 
¥v Formation flight, Docking, Proximity Operations 
¢ If anything goes wrong, reset and try again! 
¢ The satellites can be reused 
v Replenishable consumables 
v Multiple test sessions assigned per year 


Scott Kelly working with SPHERES in the Kibo lab 


Mm’ olUmer-lala me) alale Maal: mj ey-(ex-M-an ine) alitt-valm com al-mt-lele)e- lke) atamr-1. (Mm tal-Mt-lele)e-1 ke) a’ vem] ey- (exc). 


Over 121 Test Sessions (600+ hrs. of Facility Console activities involving crew) 
One of the most used and popular ISS National Lab Facilities 
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@ SPHERES Community 


LISPHERES Working Group (SWG) Quarterly meeting 


¢ Membership includes MIT, FIT, AFS, DARPA, CASIS, SJSU, Airbus, and 
NASA (HQ, KSC, JSC, MSFC, and ARC) 
¢ Face-to-Face, twice a year 
¢ Next Face-to-Face will be scheduled in Nov. 2017 at NASA Ames 
L) Purpose: 
¢ Information sharing across the SPHERES/Astrobee community 
¢ Program office shares 
v National Lab Facility availability 
v Status of resources (batteries, CO2 tanks, etc.), 


v Overall Calendar (scheduled Test Sessions, upmass/return), and 
v Updates on “new” PD, Investigations, and ISS infrastructure. 


¢ Provide the SPHERES/Astrobee community (PD, investigators, etc.) with up-to- 
date information to determine opportunities to use the NL Facility 


¢ Discuss proposed changes/updates to SPHERES Nat Lab which may be 
required to support a specific activity or research. 


¢ Discuss specific support requests made to the ISS Office 
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rsN SPHERES Facility Team 


LI Team 

Jose Benavides, Jose.V.Benavides@nasa.gov, PM 

Aric Katterhagen, aric.j.katterhagen@nasa.gov, Ops Lead 
Jonathan Barlow, jonathan.s.barlow@nasa.gov, Eng Lead 
Jose Cortez, jose.cortez@nasa.gov 

Robert Hanson, robert.s.hanson@nasa.gov 

Simeon Kanis, simeon.i.kanis@nasa.gov 

Don Soloway, Donald.i.soloway@nasa.gov 

Andres Mora Vargas, amora@meicompany.com 
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rsN Program News & Highlights 1/3 


Aug 23rd, 2017 


3X Program News & Highlights 2/3 


U 
L) 
L) 
U 
L) 
L 
L) 


Qty 65 gen 2.5 CO2 ready for shipping by 8/31 

Building a light shade for new ISS lighting that allows SPHERES to 
continue operating in presence of IR noise 

ISS Beacon repair done, launching on OA-8 

Last Inspire-2 MIT Halo Test Session June 23rd 

Inspire-2 investigation completed with workshop on June 21° 
Successful Zero Robotics Field Day at Ames, July 7 

Successful Zero Robotics Finals competition on Aug. 11* 


a _ wees 


NASA astronaut Jack Fischer helps conduct an in-space 
competition called SPHERES Zero Robotics that 
challenges middle and high school students to guide a 
bowling-ball-sized satellite around the interior of the 
space station. 
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Tether-SLOSH kickoff May 23"¢ 
Vertigo/” Smoothing-Based Relative Navigation” Kickoff 
Astrobee project support continues 


Astrobee Robotics Software Simulator Beta release & open-sourcing 
targeted 8/31 

Guest Scientist Guide 8/31 

Mechanical Payload ICD 8/31 

Two presentations, ISS R&D conference July 17th 

Integration & Test 

Flight Build 


LJ Supported winning poster at Innovation Fair: “Ames K-12 STEM 
Challenges” 


National Aeronautics and Space Administration 


NASA Ames K-12 STEM CHALLENGES 


PN aat=-M@)ii(e;- me) (010 [er-10(0)p m= 1010 Ml wal] 0)| (om @]Uiic-1- (eam @val-li(-1ale [oma -1- 1008 
SY ole) abso) ¢=10 i )¥ am (e) 00m @ri- 1011-10 Cm =) 
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ren Summer 2017 Interns: Qty 8 


LY Aris Koumis & Dean Yuan: Astrobee Microbial Sampling Payload (AMSP) 


Design Overview 


ENS) ie) el--} 


N § Ip RZ i Sampling Device 
LI Eddy Meza: SSLA Shade 


—_———_ Rotary Indexing 
Mechanism 


1Or-Tatacele[= 
Ring 
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@ Summer 2017 Interns: Qty 8 


QO Elizabeth Nguyen: Astrobee Payload Expansion Port Tester (APEPT) 


QO Jacob Killelea: Multi-robot Communication 
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I. Electrical 


The development of the hardware for 


is 


2h 


3s 


4. 


Bis 


The system shall establish USB connection with the Astrobee 
using the USB data pins on the payload interface. 
a. The system should identify the Astrobee as a USB device. 
b. The Astrobee should identify the payload as a device. 

c. The system should be able to transmit and receive data. 
The system shall test and demonstrate current and voltage 
outputs 
a. The system should show a possible current draw of 3A. 

b. The system should show voltage levels of ~14.4 volts. 

c. The system should limit the current draw of the payload. 
The system shall be able to attach to the payload interface 
using both the lever method and the screw method. 
The system should have on board computing capabilities for 
guest science/test software. 

The system should enhance the mechanical mounting of the 
payload interface to allow for additional attachments. 


the APEPT was centered around the use of 


the BeagleBone Black (BBB) 


- a single- 
board computer/microcontroller: chosen 


= 


j— 


rs. 


stom PCB layout was 
yx the BBB to organize and 
1 additions to run the port 


the APEPT 


was 


CAD model for the 


Astrobee. 
sal unit, 


de 


The model was 
LCD display 


om 
Td 


“ 
ROS 


(Bonus) 


FOUND THE BONE. 


Payload Connector 
Pin Types 


For the software development of the 
APEPT, several different frameworks 
were studied: 


1. Robot Operating System (ROS) 
2. Android OS APK development 
3. JavaScript + BoneScript + NodeJS 


The ROS and Android framework were 
chosen because Astrobee currently uses 
these frameworks for operation. The 
JavaScript + NodeJS was chosen by 
recommendation and BBB community 
tutorials. 


Each of these frameworks are 
implemented on either the APEPT or 
Astrobee to conduct the port tests and 
serve as example use 
cases/implementation guides for guest 
science. 
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ne Summer 2017 Interns: Qty 8 


Matt Moropoulos: SPHERES-Hook 
Michael Richardson: MGTF Control Software 
Q Rachel Crum: Payload to Ground Communication 


LU 


APPROACH & PROGRESS 


Understanding DDS 
* Researched messaging protocols, specifically DDS. 


Implementation Design 
* Decided upon python for its great documentation, readability, ease of use, and consistency with oe sco 
* Established thet @ reader script would subscribe to DDS messages and send the message to the visualizer 


Practice Makes Perfect 


+ Developed reader and writer scripts that sent messages to each other. 
* Developed o reader script that subscribed to the Astrobee simulator and received position data, 


Separate ROS from the Current GNC Visualizer Code 
* Two seporate ROS and DDS scripts that would be imported based on o user defined flag. 
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What’s next... 


Next ZR competition is under way 
New Vertigo Smooth Navigation 
research 

Tether-Slosh 

Continue work transitioning to 


Astrobee 
Q Goal: Fully operational in 2018 


L 
U 
L) 
L) 
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sy Guest Science Program (GSP) 


L) What's available from the Astrobee Facility? 


Q) 


Oooo 


i) 


Astrobee Robotics Software Simulation 
Ground Hardware: Qty 3 & ”Flat-Sats” 
Labs: Granite & MGTF 

Documentation and Training 

Proposal Support 

ISS Payload Partner 


LJ How can | use Astrobee and what does it take? 
Q Guest Scientist Guide & Mechanical Payload ICD 
QO New Hardware or ’just” Software? 
QO Ground Demonstration or ISS Operation? 

LJ We want to hear from you! 
QO Approximate Scheduling 
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SPHERES & Astrobee 
Operations 


Aug 23, 2017 NASA — MITSSL — UMD SPPL —- DARPA — NRL — AFS -— FIT 


Operations: Functions 


bo 


Ensure Facility Readiness for ISS Test Sessions 
> All crew training now via Onboard Training (OBT) both English & Russian 
> Crew procedure updates 
> Coordinate with ISS Lead Increment Scientist and POIC Cadre 
> Flight products on orbit (test plan, .spf, on-board training and review, etc.) 
> Consumable (CO2 Tanks and Batteries) refurbishment and resupply 
> Support SPHERES directory/file maintenance 
Real-Time ISS Test Session support 
> Coordinate w/SPHERES investigators product development and delivery 
> Support crew and POIC cadre real-time 
> Conduct/coordinate crew conferences as needed 
> Test session data and video management 


Public Relations 
> Maintain website, work with ARC PAO office to publish material on site 
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Operations: Functions 


bo 


Increment Planning 
> PTP and 2-pager development, and update & support and submittal 
> Timeline planning model review and update 


Safety and Verification Assessments 
> Integrated Safety & Verification Assessments for all SPHERES payloads 
> Safety & Verification assessments for Battery/Tank launches/returns 
> Complete Certification of Flight Readiness for ground systems and 


on-orbit hardware and operations products 
> Conduct ISS Requirements Change Assessments to SPHERES Facility 


Astrobee Ground Ops Development 
> On orbit Activity planning and development 
> Ground Operations Readiness Test planning and development 
> First ISS Ops - Mapping Activity being planned, procedure in final stages 


Aug 23, 2017 NASA — MITSSL — UMD SPPL — DARPA — NRL — AFS — FIT 2 


Ops: Increments 51/52 Review 


Increments 51/52 (April 2016 to Sept 2017) 
> Increment planning on going for 53/54 (Sept 2017 — March 2017) 

> Planning for Tether-Slosh, Smoothing-Based Relative Navigation, Zero Robotics 
> Planning also for potential Slosh Coating, and follow on Docking Port ongoing 
> Consumables and hardware manifest support for SpX-11, OA-7, 67P and SpX-12 
safety, verification for these flights — summarized on later Ops slide and in PIM 
presentation 
Supported InSPIRE II Workshop at NASA HQ June 21 
Procedure and hardware development supported at MIT July 6-7 
Supported and presented ISS Conference in Washington D.C. 


VV VV 


Aug 23, 2017 NASA — MITSSL — UMD SPPL — DARPA — NRL —- AFS — FIT 3 


Ops: Increments 51/52 & 53/54 


51/52 (Apr 2017 — Sept 2017) 53/54 (Sept 2017 — March 2017) 


> Halo Science 1 June 23 2017 

Zero Robotics Unit Test/Dry Run Aug 4, 2017 
> Zero Finals Aug 11, 2017 
SSaSeasesasaeseseeaseaeaasen (as 24 | Sasa eee ase eee see eaeeeSaa= 
> Tether-Slosh TBD 
> Smoothing-Based Relative Navigation TBD 
> Zero Robotics High School Units Test Nov- Dec 2017 
> Zero Robotics High School Dry Run Jan 2018 
> Zero Robotics High School Finals Jan 2018 
SSSSSeeseesseeas==oseses=—==| PO = possible |=eaaeease= eee eee ese Sees == 
> Additional Docking Port TBD 

Slosh Coating TBD 


Aug 23, 2017 NASA — MITSSL — UMD SPPL — DARPA — NRL —- AFS — FIT 4 


SPHERES Calendar 
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Consumables Status 


bs 


CO2 Tank Inventory 
¢ X Tanks on orbit now 
¢ Planning to up mass pink tanks fall/winter 2017-18 — flight TBD 
¢ Total: X gray tanks 


Battery Pack Inventory 
¢ X Batteries on orbit now 
¢ 10 SPHERES Rechargeable Batteries arrived on station with OA-7 


Consumables downmass 
¢ 13 empty gray tanks to be returned on SpX-12 
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Topics | Missions Galleries | NASATV | Follow NASA’ | Downloads | About | NASA Audiences search 


Twitter 


Website 
SPHERES 


Ames Research Center Overview Images Videos Media Resources 


Follow 


SPHERES Blue s Pa What is SPHERES? 


\ Satellite Repair 
f ¥co@ : Complete 


SPHERES Home 
Mission Overview 
History 

Satellites 


Facilities 

« SPHERES 
Maintenance Test 
Session 


Partners and Affiliates 
Guest Scientist Program 
SPHERES Publications 
FAQ 


Archived Science 


Related Topics 


NASA Ames Middle school Tweets ty @nasa sPHE 
students visit 


PGA wace courere 
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Astrobee System Overview 


SPHERES/Astrobee Working Group 
August 23, 2017 


Free Flyer 
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System Data Flow Diagram 


Link Legend 


Ethernet/LAN 


Payload 
LAN 
Switch 


B | 
tele Ethernet: 


Internal IP 


Ethernet: 
Internal and 
Payload LAN 


WiFi: 

le | Payload LAN 
Payload JSL : 

Payload LAN 


USB 


Other/LAN 


Storage 


GS Inst ARC MMOC MSFC JSC MCC 
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Astrobee 


; Battery 
Terminate Button 


Nozzle 
SpeedCam 


Ne 


HazCam 


Touch Screen 


Power Switch PerchCam 


DockCam 
Forward Flashlight Aft Flashlight 


Wake Button 


Signal Lights 


Impeller Corner Bumpers 


Status LEDs 
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Payload Attachment Options 


4X Fastener Payload Attachment 


Quick “No Tool” Payload Attachment 


2X Lever 
(open position) 


4X Captive_ 
Fasteners 


Lever engages and 
disengages 
payload connector 
and provides 
mechanical 
attachment 


Lever in “Locked” 
ee ~ > 4 
position ng, 


a“ ” 
“Un-Lock” noe 
Position Position 
8/23/2017 SPHERES/Astrobee Working Group 5 


Dock 


Subsystem Breakers 


Cooling Fan 


i Cooling Fan Screen 
Air Vent Deflector Main Power Breaker g 


RJ-45 Connector 


eas Try 


Bae wd (SRE SEER Cad 


Je 
. er enere eres , 


Power Connector 


Free Flyer Berth AR Target 
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Plan Editor Tab (Operator/Engineering) 


Modeling Help 
Plan Editor | Run Plan| Teleoperation 


GPS 15Jun16 20:36:18 


Z Interactive Plan Viewer 
Plan Editor 

Plan Name BB 
Estimated Duration 00:16:34 


Validation Validated 


Plan Step Duration 

« BB 
0 Station 
0-1 Segment 
1 Station 
1-2 Segment 
2 Station 
2-3 Segment 
3 Station 
3-4 Segment 
4 Station 
4-5 Segment 
5 Station 
5-6 Segment 
6 Station 
6-7 Segment 
7 Station 
7-8 Segment 
8 Station 
8-9 Segment 


List view 
of Plan 


| Add le 


2 Station 
Location Based | Coordinate Based | Bookmarks | Commands 
Bay \2 oa 
Offset Wall1 {¥| Center | Deck 


Offset Wall 2 || Center 


Element 
editor 


Orientation [¥| N/A Forward! 


00:00:00 Message goes here 


Run Plan Tab i 


File Edit View Help 
Run Plan | Teleoperation Guest Science 


FreeFlyerA ¥| Comm @ Control DW@DW-Windows7-32 Batt Docking Station @ GPS 11Jan17 18:19:32 


Health and Status Details) Initialization Robot Commanding 


Operating State Ready 


Wak File ws | (C:\Users\DW\Desktop\FPlans\ExamplePlan.fplan i 
Mobility State ener ake File... | p\ p P Select valid plan 
Operating Limits Default_Safeguard Plan Valid and u p load to 
Plan ExamplePlan ae Astrobee 
Plan Status Paused 


Description 
A plan that goes in a spiral. 


Plan Live Telemetry | Live Images Science Camera 


Total Elapsed Time 00:00:00 


Plan Step Duration 
4 ExamplePlan 
0 Station 
0-1 Segment 
1 Station 
1-2 Segment 
2 Station F ‘ 
sain List view 
3 Station of loaded 


3-4 Segment | 
an 
4 Station , \V 


Model of 
loaded 
plan 


4-5 Segment 
5 Station 


18:19:17 FreeFlyerA: Set Zones 


File Edit View Help 
Run Plan Teleoperation Guest Science 


[FreeFlyerA y, Comm @ Control DW@DW-Windows7-32 Batt 87 
Manual Commanding Perching Arm | Docking 
Health and Status : 
Initialization Manual Inputs 
Operating State Ready = 
Mobility State Stopped 
Operating Limits Default_Safeguard Wake 05 > Fwd 
Plan 
Plan Status Idle 
Grab Control 05 |? Stbd 


0.0 + Deck 


| \eiaiiaatandalaciad ns 


Configurable Teleop Commands 


Construct 
movement 
command 


BiS2 


LABAS\ 


LAB1S3 


Buttons here 
can be changed 
via config file 


01:44:24 FreeFlyerA:; Unknown Command Completed 


Teleoperation Tab ai) 


Docking Station @ GPS 12Jani7 01:46:27 


Options | Commands 


Pitch «¢ -00 > 


Yaw ¢ -45.0 > 


movement 
command 


LAB1S5 / 


settings 


Center on Bee 


[ride Preview ] 


Drag preview 
to adjust 
movement 

command 


File Edit View Help 


Run Plan Teleoperation Guest Scie 
= Checkboxes 


select Astrobees 
to command 


Docking Station @ GPS 17Jani7 18:44:47 


Plan Status Health 


Names of 
loaded 
Plans 


Status 
summaries 


Commanding for FreeFlyerB Live Telemetry | Live Images Science Camera 


3rab Control 


Monitor 
Astrobee 
positions in 3D 
window 


Run 


Manual Commanding 


Guest Science Command Reset View 


Z| 


Center on Bee | 


Send Command 


Command 
Astrobees 


18:41:36 FreeFlyerB: Grab Control 


Advanced Guest Science Tab 


(Operator/Engineering) 


Plan Editor Run Plan | Teleoperation Guest Science Advanced Guest Science Advanced | Advanced 2 Modeling Debugging 


Select APK to 
see Status 


Station @ GPS 18Jan17 20:00:58 


Astrobee Selection and Status 


Control Batt Summary Plan Plan Status Plan Step APK Status 


DWODW Windows? 32 ———aes ise Running 


]Frec Flyer 100 eS ns 


{ Details 


Commanding for FreeFlyerA, FreeFlyerB Live Telemetry Live Images Science Camera | Guest Science Telemetry 


AstrobeeA +) AstrobeeB ¥ 
APK STATUS APK STATUS 
Pl 
wie Sta rt a nd Sto p Turbo Idle Turbo Idle 
AP Ks di rect ly Grappling Hook Idle Grappling Hook Running 


Geiger Counter Running Geiger Counter Idle 


Grappling Hook 


View detailed 


telemetry 
Manual Commanding 
APK Template fro m A P Ks 
| Geiger Counter ’ [Run Test nA 
APK Topic Label Value 
Geiger Counter Astrobe.. Status "Off" APK Topic Label Value 
Geiger Counter Astrobe.. Summary "Nominal" G ling Hook Astrob. Stat "OFF" 
Geiger Counter Astrobe... Data 235 ————— ~ = 


Grappling Hook Astrobe... Summary "Nominal" 
Grappling Hook Astrobe... Data 25 


Preview and 
change APK 
command before 
sending 


19:59:45 FreeFlyerB: Start Guest Science gov.nasa.arc.irg.astrobee.GrapplingHook 


Advanced Tab (Engineering) 


ae gir kbenct 
File Edit View Modeling Help 
Plan Editor Run Plan |Teleoperation Guest Science | Advanced Guest Science Advanced | Advanced 2 Modeling Debugging 
| FreeFlyerA zy Comm @ Control nobody Batt Docking Station @ GPS 18Jgp 
Detailed Health and Status FreeFlyerA Operating Limits FreeFlyerA Data to GDS 2 Confi gure 
Select Operating Limits Configuration ... Telemetry Current Freq (Hz) Change to (Hz) 
Control nobod: = 5 te | em et ry 
y Configure Data . d position 5 [set] 
Operating State Ready V lew an t t 
ss 7 : sent to 
Raw Mobility State Stopping ekfState 
Sub Mobility State 0 sone M cha nge rf Control 
: Profile Name De | commStatus 8 5 (set! 
Operating Limits Default_Safeguard . . ri 
ce Flight Mode D Operating Limits | ee 7 5 (set Station 
Plan Status Idle Target Linear Velocity 1.0 | - = 
Temperature - Deta | led H ea It h — oe a rad/s I Camera Streaming Resolution FPS 
Arm Mobility : = 
Arm Gripper = and Status Target Angular Accel _| 1.0 rads/s science No [) 640.480 [640.480 ~|00 0000 00 [Set| 
Collision Distance 1.0 m | 
Check Obstacles true navigation __ 3) 00 00 {set| 
Check Keepouts true = 
a et? | hazard No ©) 640480 [640.480 v]00 00 00 00 [Set] 
Fault ID Description Subsystem Node FreeFlyerA Power State FreeFlyerA Data to Disk 
4 Triggered Battery Total 1 i 
| Sotum binepeee ry cae Detailed Download Data | | Stop Data Download | { Clear Data 
7 Fuse i ki N 
12 / ‘use is broken Subsystem C ode 3 Coe 2 b a tt e ry 
4 Not Triggere c- Disk Data Size (GB) Disk Size (GB) 
100 Processor overheated Subsystem A  Nodel Botte an st a t us Disk A 0.000002 0.000002 
201 Arm Overcurrent SubsystemB Node3 yy, 
Batt1 No Disk B 0.000003 = 
mae No Disk C 0.000003 
Disk D 0.000003 
Batt 3 Yes 32 16 . | 
aka No : . Disk E 0.000005 Disk usage 
Batt 5 Yes oi 30 mer: Saunas 
: Batt 6 Va B 10 Disk G 0.000005 
Triggered and Batt7 No ; : 
Not Triggered 
Fa u l ts FreeFlyerA Component States Sea are Freq (Hz) 
Component Present Powered Temp (C) Current (A) RosTopicO Immediate 5.0 
HLP Yes No 33 1.458 RosTopicl Immediate 5.0 
MLP Yes Yes 112 2107 RosTopic2 Immediate 5.0 
LLP Yes No RosTopic3 Delayed 10.0 
Fanl Yes RosTopic4 Delayed 
Fan2 No Det ai led RosTopics Delayed ‘ 
Caml No RosTopic6 Delayed View a nd 
Cam2 Yes component A 
Cam3 Yes configure data | 
status dtedick 
M Configure Data Save O IS 
jessage 
Select a fault to view message. 
00:00:00 Message goes here 


Astrobee Status 


° Finalizing drawings 
¢ Procurement has begun 


¢ On track for August 31° delivery: 
¢ Beta release of Flight Software/Simulator 
¢ Mechanical Payload ICD drawings 
¢ Initial draft of the Guest Science Guide 
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Guest Science and Simulator 
Integration 


Andres Mora 


Simulator 


¢ Robot: ¢ Simulator: 
— Hardware includes multiple — Has the same code base as that in 
cameras, processors, actuators, the robot 
and mobility mechanisms. — Adds components to simulate the 


environment inside the ISS and the 
communication with ground control 


dng (wa len lecom tion — Allows users (Guest Scientists) to 
ee ; quickly test their experiments and 


— Runs Guest Science payload understand how the robot would 
(both hardware and software) behave. 


— Software allows localization 


sa\vdlaelalantsyaue 


Simulation Concept 


Simulator 


¢ Developers require: 


— Simulator able to run in a medium to high-end laptop (e.g. Nvidia Quadro 
K1100M — Dedicated Video Memory 2048MB GDDRS) 


— Linux environment (Currently Ubuntu distribution, LTS 16.04) 
— Integrate ROS, Android (Android Studio) operating systems 
— Simulator is based on C++, Simulink deployed C blocks 


— Developers in Android extensively use multiple programming languages: 
Java, XML 


— Provides 3D representation of the robot via Rviz and/or Gazebo 
— Provides dynamical, sensor models via Gazebo 


Software Architecture 


simulator ¢ Three ARM processors to isolate guest scientist code, vision 


based localization and GNC loop, connected by 100Mbps 
network switch 


¢ High Level Processor (HLP) — Android, Quad core 
— Interface with Science Camera and Display 
— Encodes video with dedicated hardware 
— Runs guest science code 


e Mid Level Processor (MLP) — Linux, Quad core 


— Runs absolute localization algorithms, obstacle detection, 
communications 


— Heavy processing power used by vision 


¢ Low Level Processor (LLP) — Linux, Dual core 
— Runs 62.5 Hz: EKF and propulsion control loop 


ROS messages: —> 
Sensing/Actuation: <==» 


Guest Science 


¢ Guest Science interface scenarios 


1. Basic API (Zero Robotics): handles high-level 
commands and uses Android environment only 

2. Intermediate API (Zero Robotics, University 
researchers): high-level to mid-level commands by- 
passing Android-ROS bridge but still using Java-ROS 
framework. Telemetry is accessible. 

3. Advanced API (University researchers): By-passes 
completely provided Java-ROS framework. 


Guest Science Implementation 


Android (Emulator or HLP) 
Pure Java Higher fidelity 
simulation with the 
Android platform 
Guest Science emulated Guest Science Guest 
Application Code Application Code Science 
Manager 


ARS Java API ARS Java API 
Model can be used 
on Android too if 
packaging ROS Java 
+ ARS Lib in App 


PANS tsw-Valelae)rom mis: 
ARS Lib GS Mer. 
Stub 


ROS Java 
ARS Android SVC 


ARS Lib 


NOMEN ee) 
Simulator or MLP 


Nola Nei eles 


ree Executive 
in first red oe 
release 


Android Guest 
Payload App 


Guest Science Activity 


Communication between 
different 
processes/threads 


Intercommunication 
Process (IPC) 


Services: 

— Scheduled 

— Started 

— Bound 
Messenger class to avoid 
complex AIDL 
implementations 


BIND TO ROBOT 


Comm Status 


UNBIND FROM ROBOT 


onnectec 


Android 


Android Guest Science 


Android-ROS Bridge 
Service App 


Android ROS Bridge 


ASTROBEY 


START SERVICE STOP SERVICE 


ROS/Java 


MLP 


Executive 
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Astrobee Elements / ARS 


Astrobee 


Ground Data 
System 


SS oO 


Users Development 
Testbed Astrobee Robot 


Software Scope 
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ARS (Astrobee Robot Software) 
Overview 


ARS is deployed on 4 cell phone type processors (Astrobee 

+ Dock) running Linux and Android 

Astrobee contains 7 distinct microprocessors with custom 

firmware + several microprocessors with COTS firmware 

Software deliverables includes: ' 
— Custom firmware(s) 

Custom tailored Linux kernels 


Linux and Android Operating Systems 


ARS dependencies (third-party libraries) 
ARS Source Code < Open Source 


ARS Features 


Manage Astrobee sensing and actuation 


Localize and Navigate within the ISS 


Perform autonomous docking 
(+ return to dock) 


AG; 
Support teleoperation from groun Oe 
Support plan based automated task 


Support “Guest Science” operations ae 
less mature 


Support multi Astrobees communication 


Support hardware for multisensory 
human interaction 


ARS Components 


OS (Communication Framework) 


Localization en ee ee 
: irectory -by-Language 
— Marker less Flying 1367376 gnc cpp=1367280 
— Docking 45474 submodules ansic=20471 ,java=7963 
— Perching 14262 mobility cpp=14015 


: ; . . 12351 localization cpp=11923 
Offline mapping for localization 9803 hardware  cpp=9366 


. . . Z i hon=3527,sh=1844 
Pose Estimation + Propulsion Control (GNC) 3453 Sraca  Seonveaaa 


Executive 6279 management  cpp=6090 
4778 tools cpp=2290,ansic=984 

— Mode Management 3600 communications cpp=3524 

— Sequencer (Plan Execution) 

Mobility 


— Generates and validates trajectories 


— Performs collision detection Totals grouped by language: 


cpp: 1422365 (96.05%) 
Fault Management without autogen: 58305 
. ansic: 21455 (1.45%) 
Guest Science xml: 14956 (1.01%) 
User Interfaces Support python: 9792 (0.66%) 
java: 7963 (0.54%) 
Simulator sh: 2867 (0.19%) 


Platform Management and development tools 


ARS and ROS 


e ARS makes extensive use of the 
open-source Robot Operating 
System (ROS): 

— Communication framework 
linking all “nodes” running on 
the target platform 

— Try to maximize the re-use of 
existing ROS messages benefit 
from existing ROS packages 

— Use ROS introspections tools to 
rapid debugging 

— Use ROS facilities to 
record/replay/analyze data 

— Use some ROS/Gazebo 
components for the simulator 


Simulator 


¢ Custom propulsion 
system and some 
localization sensors 


¢ Gazebo based 
dynamics model, 
imagers, arm, lights 
and ISS model 

¢ Can run all nodes 
on desktop or some | 
nodes on target 
development board | 


Reset Left-Click: Rotate Middle-Clicic Move X/Y. Right-Click/Mouse Wheet: Zoom Shift More option 


ARS APIs Overview 


ARS uses ROS within Astrobee: Messages, Services and 
Actions define the internal API 


Astrobee & Ground communication uses DDS and the RAPID 
framework for command and telemetry 


Commands: 


— Commands are defined using XP-JSON schema, tools auto-generates 
RAPID command dictionary 


— ARS defined a ””ROS Command” mirroring the DDS command structure 
— Onboard Astrobee Guest Science or Ground Applications share the 
same command dictionary (some commands unique to one client) 
with either DDS or ROS transport 
Telemetry: 
— Internal uses ROS Messages (using ROS messages when possible) 
— External uses DDS Messages (subset only, re-using RAPID messages) 


ARS APIs Access 


RAPID Commands 


(DDS) DDS Bridge 


ROS 
“Command” 


Operator Access 
Control 
ROS 
“Command” 


Executive 


Services, Actions 
or Topics (all ROS) 


Subsystems me 


Guest Science 
App (HLP) 


Control 
Station 


ROS 
messages 


ROS messages 


SPHERES Engineering 
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ren Hardware Status 


L) Hardware status 


¢ Red: 100% 
* Blue: 100% 
¢ Black: 25% 
¢ Orange: @ MIT 
¢ Stack: 100% 
¢ Battery recharger: 4 of 4 
¢ New air carriage: 3 of 4 
v Tall 3-puck: 2 of 3 
v Single puck: 1 of 1 
¥ More in work 
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PsN Ground Lab Status 


* Granite Lab: Online * Flight Lab: Online 


: wis EF 
« Engineering Evaluation Lab (EEL): Available upon request 
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réN SPHERES ISS Beacon Repair 


Inventory 
LJ Corrosion discovered from Batteries 

LJ Discovered by Jeff Williams during TS82 (Maintenance Session) 
Results 

LJ Arrived at Ames 

LJ Battery holder replaced, cleaned, and inspected 


L} Returned to station 
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@ Gen 2.5 Pink CO2 Tank Status 


LI Inventory Status 


¢ ~60 Tanks Ready for Filling 
¢ Decals Arrived ( IMS Barcode / 
Hazzard waste / Fill Status ) 
LI Schedule 
¢ ~1 week to finalize product ( fill, label, 
bake out) + 1 week Idle leak check 
¢ Full delivery mid September 
LI Notes 
¢ Under-Torqued pin-valve issues on 


Gen 2.0 has been resolved with new | 
oversight and integration at Ames. 
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PsN Lab Upgrades: MGTF 


LJ Environmental effects 
¢ Background 
¢ Mock ISS Panels 
¢ LED Lighting 
¢ Active Gimbal 
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@ victr Gimbal 


LI Gimbal Specs 
¢ Active Gimbal a 
(N \J cass | 


¢ Yaw 360° Roll 126° Pitch 180° 


¢ Weight ~ 30lbs alert sual, 
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UI JEM GLA lights are planned to be replaced soon by SSLAs 
LI SSLAs cause IR noise andre sets SPHERES 
UI Prototype testing at JSC early next month 
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réN SSLA Shades (Remember this?) 


be 


Software: Gantry Control 


6dof Control: 

> Matlab control software. 

> Position, Velocity, or 
Acceleration 
commanding. 

>Visualeyez for ground 
truth 

> Real time commands 
from simulation or from 
the payload over Xbee. 


Status: 
> 6-DOF operational. 
> Testing in progress 
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